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Abstract 

In this paper, we make use of the Metropolis- type walks due to Nonaka et al (2010) to provide 
a faster solution to the ^-^-connectivity problem in undirected graphs (USTCON). 

As our main result, we propose a family of randomized algorithms for USTCON which 
achieves a time-space product oi S-T ~ 0{n^) in graphs with n nodes and m edges (where the 
0-notation disregards poly- logarithmic terms) . This improves the previously best trade-off of 
0{nm), due to Feige (1995). Our algorithm consists in deploying several short Metropolis- 
type walks, starting from landmark nodes distributed using the scheme of Broder et al. 
(1994) on a modified input graph. In particular, we obtain an algorithm running in time 
0{n + m) which is, in general, more space-efficient than both BFS and DFS. 

We close the paper by showing how to fine-tune the Metropolis-type walk so as to match 
the performance parameters (e.g., average hitting time) of the unbiased random walk for any 
graph, while preserving a worst-case bound of O(n^) on cover time. 
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1 Introduction 



In the undirected S^-.'^ connectivity 'problem (USTCON), the input to the algorithm is an 
undirected graph G = (V, E) with n vertices and m edges. Two of the vertices of the graph, 
=5^, ^ V , are distinguished. The goal is to determine whether and £^ belong to the 
same connected component of G. USTCON has a spectrum of applications in various areas of 
computer science, ranging from tasks of network discovery to computer-aided verification. The 
problem has also made its mark on complexity theory, most famously, playing a central part in 
the rise and eventual collapse of the complexity class SL. 

The time complexity of algorithms for USTCON depends on the amount of space available 
to the algorithm. Given 0(?7-) space, USTCON can be solved deterministically in time 0{m) 
by fast algorithms such as BFS or DFS. Given O(logn) space, the problem can still be solved 
deterministically [21] in polynomial time. However, in this case the fastest known solutions are 
randomized. Aleliunas et ai. [2j proposed a log-space algorithm with bounded error probability, 
which consists in running a random walk, starting from node 5^ for 0{nm) steps, and testing if 
node ^ has been reached. 

The study of the interplay between the space complexity S and the time complexity T of 
randomized algorithms for USTCON was initiated by Broder et aJ. |10j . They observed that 
both BFS/DFS, and the random walk, admit the same time-space trade-off of T = 0(-^), 
and investigated whether there exist algorithms with such a trade-off for an arbitrary choice 
of 5*, c • log re < S < n, where c > is some model-dependent constant. After a sequence of 
papers relying on the deployment of many short random walks, this question was eventually 
settled in the affirmative by Feige jl4j, who proposed a family of algorithms which achieve such 
a time-space trade-off in the whole of the considered range of space bounds. 

The main result of this paper is an improved time-space trade-off for USTCON. Since the 
cover time of the random walk is precisely O(rerre) for some graphs, any improvement with respect 
to Aleliunas et al. [2] or Feige [H] requires a refinement of the performed walk on graphs. Instead 
of the random walk, we make use of the Metropolis-Hastings walk on graphs, with weighting 
proposed by Nonaka et al. [20]. This walk covers any undirected graph in 0{n?) steps, but its 
transition probabilities rely on knowledge of the degrees of neighboring nodes at every step. We 
start the technical sections of this paper with an explicit implementation of the walk from |20] 
using the Metropolis sampling algorithm from |l8j. This yields a solution to USTCON in 0{v?) 
time and logarithmic space. Our contribution lies in completing this quadratic time-space trade- 
off for larger bounds on the space complexity of the algorithm. The main technical difficulty 
concerns overcoming problems with short runs of the Metropolis-Hastings walk, which sometimes 
exhibits inferior behavior to the random walk in terms of the speed of discovering new nodes. 

For the entire range of space bounds (c • log re < S" < re), we propose algorithms running in 
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time T = 0(max{^, m}). In other words, we obtain T = O(^) for S < and T = 0{m) 

2 

for S > (Note that T = Q{m) is a lower bound on execution time for any algorithm 

for USTCON, regardless of the space bound.) In particular, we prove that USTCON can be 
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solved in time 0{m) using space 0(— ), which is, in general, less than the space requirement of 
BFS/DFS. 

All of the considered algorithms for USTCON are randomized (in the Monte Carlo sense), 
with bounded probability of one-sided error. This means that the positive answer "connected" 
may only be reached by the algorithm when and J7 belong the same connected component 
of G, whereas the negative answer "not connected" signifies that, with probability at least 2/3, 
^ and £^ belong to different components of G. 



1 



1.1 Related work 



Much of the work on undirected S^-^ connectivity has focused around its role as the funda- 
mental complete problem for the symmetric log-space complexity class (SL). A survey of other 
important problems identified as belonging to the class SL, such as simulating symmetric Tur- 
ing machines, and testing if a graph is bipartite, is provided in AGCR. A major line of study 
concerned determining the minimum space required to solve USTCON deterministically. The 
bound on the required space was reduced, over several decades, from the 0(log^ n) bound given 
by Savitch's theorem |22j, through 0(log^/^n) [23j, and 0(log^/^n) t4j. Finally, in 2004, Rein- 
gold's [21] new construction of universal graph exploration sequences provided the first log-space 
algorithm for USTCON, showing that SL=L. Befor Reingold's paper, Nisan pTO] had shown a 
deterministic algorithm for USTCON running in polynomial time and O(log^n) space. Borodin 
et al. [9j proposed a log-space Las- Vegas type algorithm for USTCON (with no-error) which 
runs in expected polynomial time. 

When considering randomized algorithms with bounded one-sided error, the unbiased ran- 
dom walk was shown to solve USTCON in 0(log n) space and 0{mn) time by Aleliunas et al. [2\. 
Several years later, Broder et al. |10j proposed a family of algorithms based on short random 
walks starting from landmark nodes. Relying on landmarks chosen on the set of nodes according 
to the stationary distribution of the walk, they achieved a time-space trade-off of T = O(^). 
Subsequent algorithms from the literature [51 E] make use of different landmark distribution 
schemes. Barnes and Feige [5] achieve a trade-off of T = O C" — ) by using a mixed landmark 
distribution scheme, which places half of the landmarks according to the stationary distribution 
of the random walk, and half according to the uniform distribution on nodes. Feige [H] intro- 
duces the inverse distribution scheme, which likewise places half of the landmarks according to 
the stationary distribution of the random walk, and the other half according to the inverse of 
node degrees. He achieves a time-space trade-off of T = 0{ ^^^^ ) in general, where 6 is the 
minimum degree of the graph. Thus, the trade-off of T = O(^) is reached for the case of 
(nearly) regular graphs. 

Undirected S^-S^ connectivity is a special case of the more general reachability problem in 
directed graphs (STCON), which is a complete problem for the class NL. STCON can also be 
solved deterministically in O(log^n) space using Savitch's theorem [22]. So far, it has resisted 
fast solutions in small space. This problem was extensively studied in different variants of a 
model of computation based on Jumping Automata on Graphs (JAG-s). The memory of a JAG 
is organized in the form of P pebbles placed in the graph and Q states of the automaton, with 
space defined as 5 = Plogn + logQ. Cook and Rackoff [12] show a way of solving STCON in 
the JAG model deterministically in O(log^n) space, and also prove an almost matching lower 
bound on space of r2(log^ n/loglogn). This lower bound is also known to apply to randomized 
JAG-s running in slightly super-polynomial time [8]. Gopalan et al. ^15j propose a family of 
algorithms for STCON based on short random walks, whose runtime increases from 0(re^°s") to 
0{n"') as space decreases from O(log^n) to O(logn). 

Finally, we remark on recent developments in the area of graph exploration with biased 
random walks. Ikeda et al. ^17j and Nonaka et al. [20] studied possible adjustments to the 
transition matrix of the walk based on the availability of local topological information (otherwise 
known as "look-ahead" ) . In general, the idea of these approaches is to increase the probability 
of transition to a node of lower degree. The former paper introduces a new type of walk, called 
the /3-walk, whose transition matrices are biased so that transition from a node to its neighbor 
of degree d is proportional to d~^. Such a walk was shown to visit all nodes of the graph 
in 0(n^ log n) steps in expectation for an optimal choice of parameter /3 = 1/2. Nonaka et 
al. [2D] later used the key lemmas from this work to prove an analogous result for a walk with a 
modified transition matrix, which fits into the class of Metropolis-Hastings walks. This walk is 
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the starting point for considerations in our paper. A somewhat different approach was adopted 
by Berenbrink et al. [7] , who show that a random walk with the additional capability of marking 
one unvisited node in its neighborhood as visited can be used to speed up exploration. 

1.2 Overview of the paper 

The organization of the technical parts of the paper is the following. In Section [21 we recall 
the definition of the Metropolis-Hastings walk and provide its efficient implementation using the 
Metropolis algorithm. In this way, given a representation of graph G, each step of the walk can 
be simulated by a procedure running in 0(1) time and using 0(logn) bits of space. 

We subsequently identify the key properties of the unit-potential Metropolis-Hastings walk, 
denoted RW{Gi), which allow it to be used as a replacement for the (unbiased) random walk on 
G, denoted RW{G), in algorithms solving USTCON. The major difference between these types 
of walks is that a short random walk RW{G) has the desirable property of low edge-return rate, 
i.e., each edge of the graph is visited 0{\/t) times in expectation during t steps of the walk (for 
sufficiently small t). However, no analogous property hold for the Metropolis-Hastings walk. 
In fact, on some graphs (e.g., the glitter star defined in [20]), the Metropolis-Hastings walk 
RW{Gi), will in expectation discover only 0(1) edges during t steps of the walk, visiting each 
of these edges 0,{t) times (for any choice of t < n). We overcome this problem in two stages: 

• In Section[2]we prove that in a graph of maximum degree A, the Metropolis-Hastings walk 
RW{Gi) begins to achieve a low node-return rate starting from a threshold length of 
steps: a Metropolis-Hastings walk of length t, A^ < t < n^, visits each node of the graph 
0{^/t) times in expectation. This property is formally stated as Lemma [2j 

• In Section [3] we show how to obtain the trade-off T = 0(max{^,m}) for an arbitrary 
choice of space bound S. Our initial approach makes use of a modification of a technique 
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introduced by Broder et al. [TUj. It consists in running p ^ S walks of length t ^ ^ 
each, which originate from an appropriately chosen subset of p nodes of the graph called 
landmarks. In our formulation, the walks used are Metropolis-Hastings walks (rather 
than random walks on G), and the set of landmarks is sampled uniformly on V. By 
observing the visits of each of these walks to other landmarks from the set, it is possible 
to obtain information about paths connecting different landmarks. When the performed 
Metropolis-Hastings walks have a low node-return rate (i.e., when t > A^), the obtained 
information turns out to be w.h.p. sufficient to find an answer to S^-S^ connectivity with 
a low probability of error. Otherwise, when t < A^, we modify the approach, performing 
a logical transformation of graph G. We split each node of degree greater than \/t, so 
that the maximum degree of the modified graph does not exceed Then, all of the 
considerations are performed for this modified graph. In particular, the set of landmark 
nodes is chosen by uniform sampling on the set of nodes of this modified graph. The 
overhead associated with this transformation is just small enough for our algorithm to 
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have the claimed time complexity of T = 0(max{^,m}). An implementation of the 
complete algorithm is provided in Appendix A. 

Finally, in the closing Section [J] we discuss the tightness of the obtained results. We also pro- 
pose a modified weighting of the Metropolis-Hastings walk which performs faster than uniform- 
weighted Metropolis-Hastings for many classes of graphs, while still covering all the nodes of the 
graph in 0{n^) time. This walk satisfies the property that its commute time between any pair 
of nodes (and consequently also the average hitting time) is asymptotically upper-bounded by 
the values of the respective parameters for the unbiased random walk. In particular, it covers 
all the nodes of the previously mentioned glitter star, in expected 0{n) steps. 
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1.3 Notation and model 



The input graph G = {V, E), with |y| = n and \E\ = m, is simple and not necessarily connected. 
In order to simplify notation for complexity bounds, we assume m = ^}{n). The degree of a node 
V G V is denoted by deg(f), the neighborhood of node v by T(v), and the closed neighborhood 
of V by r+(v) = r(t;) U {v}. The maximum degree of the graph is denoted by A. The arc set 
E <^ V X V of undirected graph G is understood as the set of arcs of all edges and self-loops 
of G: E = {{v,u) : V £ V,u £ T~^{v)}. An arc {v,u) £ E is sometimes denoted as €yu for 
compactness of notation. Note that the symbols V, E, A, n, m always refer to the input graph 
G. When considering a different graph X, we will sometimes denote its vertex, edge, and arc 
sets by V{X), E{X), and E{X), respectively. 

Our algorithms are designed for the classical RAM model of computation. No special 
assumptions are made on the representation of graph G, except that for any node v £ V, 
there should exist a local ordering on the set of its neighbors, given by the bijective function 
PORTy : T{v) — {0, 1, . . . ,deg(w) — 1}. Each of the following operations should be possible to 
implement in 0(1) time: computing deg(t;), computing PORT^{u) for a node u £ r(u), and 
"traversing an edge" by computing PORT~^{i), for port i £ {0,1, ... , deg(f ) — 1}. An example 
of a permissible representation is a lexicographically sorted array of ordered pairs of identifiers 
of neighboring nodes {u,v), taken over {u,v} £ E. 

For most of the paper, we consider weighted reversible Markovian processes corresponding 
to a random walk RW{X) on some weighted undirected graph X with positive weights on arcs. 
The walk is located on the nodes of graph X, and the next state of the walk is reached by 
following an arc incident to the current node, chosen with probability proportional to the weight 
of this arc. By a slight abuse of notation, we denote the transition matrix of the walk in the 
same way as the weighted graph. Most other notation follows that of Aldous and Fill [1]. In 
particular, we consider the following random variables: 

• Na{t) denotes the number of steps in the time interval [0,t) during which the walk visits 
a, where the symbol a may represent a node, edge, or arc of the graph. 

• Ta denotes the first moment of time t > at which the walk first visits (or returns to) a 
node from a, where the symbol a may represent a subset of nodes or a single node of the 
graph. 

By writing E^y and PrQ,[i?], respectively, we mean the expectation of random variable Y, and 
the probability of event E occurring, taken over walks starting from probability distribution a 
(which may be concentrated on a single node or arc). A walk starting from an arc is understood 
as one which starts from the head of the arc at time 0, and then moves to the tail of the arc at 
time 1. 

Given a weighted graph X, we denote by Gom{i,j) = EjTj + E^Tj the commute time be- 
tween nodes i,j £ V{X). Throughout the paper, we consider only walks representing reversible 
Markovian processes, corresponding to symmetric weightings of the graph: w{eyu) = u^(e™), for 
all (u, v) £ E. In some of the proofs, we rely on the resistor network representation of reversible 
walks: for each edge e = {u, v} £ E(X) having weight w^e) on each of its arc, a resistor with 
resistance l/w{e) is placed between nodes u and v of the resistor network. The symbol R{u,v) 
denotes the resistance of replacement between nodes u and v of the network. We recall that 
Com{i,j) = R{i,j) T.eeE{x) ^(^)- M 
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2 Preliminaries: The Metropolis-Hastings Walk on Graphs 



The Metropolis- Hastings walk with potential function f : V ^ M"*" is defined as a walk on the 
weighted graph Gf = {V, E,Wf) with the following assignment of weights Wf : E ^ 

Wfieyu) = min | J^^W , for ah {u, n} G £'. 

[deg(t;) deg('u)J 

Wfie^v) = f{v) - ^ Wf{{v,u}), for all V G y, 

We recall that for a walk in state v €z V, the next state is chosen as u G T(v) U {v} with 
probability proportional to the weight Wf{eyu)- By a classical result due to Metropolis et al. [18] , 
for a given representation of graph G, a single step of the Metropolis-Hastings walk RW{Gf) 
can be simulated in 0(1) time and space by means of the procedure shown in Algorithm [TJ The 
algorithm takes advantage of the fact that w f (e^u) / Ylx£r+ {v) "^fi^vx) < deg{v) ' ^ ^ -'^(''^)- 

For a walk located at node v, it samples a node u G r(u) with uniform probability g^;^^, and 
accepts u as the new state with the appropriate probability. We remark that a step of RW{Gf) 
can also be simulated by a log-space automaton which pushes a pebble along the arc {v, u). The 
pebble remains at u if state u is accepted, and otherwise reverts to v by traversing the arc (n, v). 
Thus, one step of RW{Gf) can be simulated by at most two moves of a pebble. 



function next_state (f : node) { 

u ^ neighbor of w in G chosen uniformly at random; / / pick a new state 
with probability min{ , 1} do return u; / / accept: move to new state 
return v; / / do not accept: keep current state 

} 

Algorithm 1: State transition function on V for the walk RW{Gf). 



Definition 1. We denote by Gi the weighted graph Gf for the unit potential function f{v) = 1. 

From the next two sections, we focus on the Metropolis-Hastings walk RW{Gi). We note 
that the weights on the edges of G are now simply given by w{eyu) = min{ ^^gg^^) , deg{u) ) • 

The bound on the time required by the Metropolis-Hastings walk to discover w.h.p. the entire 
connected component containing the starting node of the walk follows from the considerations 
of Nonaka et al. |20] . (All omitted proofs are provided in the Appendix.) 

Lemma 1 ([20]). Let i gV, let H be the connected component of G containing node i, and let 
nH = \ V{H)\. Then: 

• a walk RW{Gi) of length 12n^ starting from i covers an arbitrary node j G V{H) with 
probability at least ^. 

• a walk RW{Gi) of length 24n^logn starting from i covers all nodes from V{H) with 
probability at least 1 — ^. 

By the above Lemma, a solution to USTCON, with probability 1 — ^, is obtained by running 
the walk RW{Gi), starting from y, for 24n2logn steps. USTCON can therefore be solved in 
log-space by running Algorithm [T] in a loop for O(n^logn) iterations. (We are unaware of any 
previous reference in the literature for this observation.) 
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Corollary 1. There is a log-space algorithm for USTCON which runs in time 0{n^ logn), with 
probability of one-sided error bounded by -. □ 



For our purposes, we will need a more detailed analysis of the behavior of the Metropolis- 
Hastings walk. We start by recalling that the Metropolis-Hastings walk RW{Gi) is a reversible 
Markovian process, since w{eyu) = w{euv) for all arcs. Its stationary distribution is the uniform 
distribution tt : V — )• with 7r(f) = for all v . This allows us to show the following key 
lemma which captures the "low node-return rate" property of the Metropolis-Hastings walk, as 
highlighted in the Introduction. The first claim states that a Metropolis-Hastings walk starting 
within any subset of nodes A C- V is likely to leave it within 0(|^p) steps, while its second 
claim shows that a Metropolis-Hastings walk of length t is likely to return to its starting node 
not more than 0{y/t) times. However, both of the above statements hold only when considering 
walks of duration r2(A^). 

Lemma 2. Suppose that G is connected. Let A C^V , and let i € A. For a weighted random 
walk RW{Gi) starting from node i: 

(i) the expected time to reach a node from V \A is bounded by: 

E,ry\^<(|A| + l)(6|A|+2A), 

(ii) the expected number of visits to node i before any time t, < t < 6n^, is bounded by: 

EiNi{t) < 5\/t + 2A. 

The proof of the lemma follows by an analysis of resistances of replacement along shortest 
paths in the resistor network for the weighted graph Gi. 

3 A time-space trade-off for USTCON 

The time-space tradoffs for USTCON proposed by Broder et al. [lOj make use of a number of 
short random walks, originating from a subset of nodes of the graph called landmarks. Herein, 
we design an algorithm which replaces these random walks by Metropolis-Hastings walks. 

We start by a brief overview of the landmark-based approach. When considering an algorithm 
using space S, the size of the set of landmarks is defined by a parameter p = 0(5/ logn). The 
algorithm first chooses a set of landmarks L C y consisting of p + 2 nodes: node =5^, node 
and p nodes picked (in the case of our work) uniformly at random from V. Then, a walk of 
suitably chosen length t is released from each of the landmarks. Throughout this process, the 
algorithm maintains a disjoint-set data structure (also known as "Union-Find" [16]) on the set 
of landmarks, with each set corresponding to the landmarks identified as belonging to the same 
connected component of the graph. 

Initially, each landmark belongs to a separate set. Whenever a walk starting from one 
landmark hits some other landmark, the algorithm updates the data structure, merging the 
classes corresponding to these two landmarks. At the end of the process, if landmarks o5^ and J7 
belong to the same class, then, with certainty, there exists an S^-S^ path in G, and the answer 
to USTCON is positive. Otherwise, the algorithm returns a negative result, and, in the rest of 
this Section, we focus on proving that this result is correct w.h.p. 

The runtime of the algorithm of Broder et al. is determined by the time of running p = Q{S) 
random walks of length t each, thus T = 0{tp) = O(^). To achieve the claimed trade-off of 

' — '2 2 

r = O(^), we will therefore need to use walks of length roughly t w \. 
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3.1 An initial approach 

We fix a value of the parameter p = 0{S), describing the number of landmark nodes. The 
landmark-based algorithms are built around the premise that landmarks belonging to the same 
connected component of G quickly discover each other with the help of the short walks they 
release. In particular, it is desirable that the set of landmarks in each connected component of 
G has the property that for any partition of the set of landmarks into two subsets, a short walk 
originating from a landmark in one of these subsets is likely to reach some landmark from the 
other subset. Broder et al. [lOj observe (cf. also for a high-level exposition of the argument) 
that this property is satisfied if the considered set of landmarks is good, i.e., it fulfills the following 
two assumptions. Firstly, the set of short walks originating from all of the landmarks should 
be likely to jointly cover all the arcs of the graph. Secondly, a short walk originating from an 
arbitrary starting node of the graph should be likely to reach at least one landmark from the 
set. 

Most of the analysis and key lemmas in this subsection follow along the lines proposed 
by Broder et al. We confine ourselves to a summary of the approach, highlighting the subtle 
differences resulting from the use of Metropolis-Hastings walks. We start by re-setting the good 
landmark property in the context of Metropolis-Hastings walks RW{Gi) of a specifically chosen 
length r. 

Property 1. Let L (IV be the set of p = \L\ landmark nodes, let H be a connected component 
of G, and let Up = max{7^ logn, A}, where j = 60 is a suitably chosen absolute constant (whose 
value follows from the proof of Lemma [^. We say that the set of landmarks L is good with 
respect to H if the following properties hold: 

• With probability at least 1 — ^, a set of p walks RW{Gi) of length t = rip each, with one 
walk originating from each landmark from L, covers an arbitrarily chosen arc of H . 

• With probability at least 1 — ^, a walk RW{Gi) of length r = Up, originating from an 
arbitrarily chosen node of H , hits some landmark from L. 

In the above property, the choice of the length r of the walk takes into account that walks 

— 2 — 2 

of length O(p-) lead us to the sought time complexity of O(^) for the algorithm. However, in 
order to ensure that a uniformly sampled landmark set is likely to be good, we will make use of 
the low node-return rate of the Metropolis-Hastings walk from Lemma [21 and thus we need to 
have r = ^(A^). 

We will now show that that Property [1] holds w.h.p. for a set of landmarks, each of which 
is chosen according to the uniform distribution vr on the set of nodes V. To achieve this, we 
capture the "contribution" of a single Metropolis-Hastings walk to the probability of success of 
the events described in the Property. It turns out that a Metropolis-Hastings walk of the chosen 
length r, when starting from a landmark, has probability il.{l/p) of reaching an arbitrary arc of 
the graph. When starting from an arbitrary node from V, such a walk has probability Q{l/p) of 
reaching any specific landmark. These claims are formulated in a slightly more general way as 
the two lemmas below. Their proofs take into account the low node-return rate property from 
Lemma [2Jm), and the properties of a walk starting from its stationary distribution tt. 

Lemma 3. Suppose that G is connected. For a weighted walk RW{Gi) starting from a node 
chosen according to the uniform distribution vr, the probability of traversing (a fixed) non-loop 
arc Cij before time t, where A^ < t < 6n^, is: 

Pr^[Te^^, <t]> O.lVt/n. 
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Lemma 4. Suppose that G is connected. Let j & V be picked according to the uniform distribu- 
tion IT. For a weighted walk RW{Gi) starting from some node i € V, the probability of reaching 
j before time t, where <t < 6n^, is: 

Y>Vi[Tj <t]> 0.1\/t/n. 

After combining the above lemmas and applying some elementary arguments about unions of 
independent events, we finally obtain that Property [T] is satisfied w.h.p. by landmarks uniformly 
chosen from V , provided that the considered connected component is sufficiently large. 

Lemma 5. If a connected component H G has uh > np/6 nodes, then a (multi)set of p 
nodes, picked with uniform probability from V , is a good set of landmarks with respect to H with 
probability at least I — 

The results of Broder et ai. imply directly that if a set of landmarks is good with respect to 
a connected component H, then all landmarks in H can be identified as belonging to the same 
connected component by releasing a small number of walks from each landmark, and applying 
Union-Find type operations on a disjoint-set datastructure on the landmarks. Since the proof 
does not rely on any other assumptions beyond the properties of good landmarks, the result is 
directly applicable to our considerations of the Metropolis-Hastings walk. 

Lemma 6 ([ID]). Let L be a set of good landmarks with respect to connected component H <^ G. 
Then, a set of walks of length Up each, with (3 log n walks originating from each of the landmarks, 
with probability at least 1 — 2n discovers that all landmarks located within H belong to the same 
connected component. 

In the above, the absolute constant f3 can be chosen as /? = 72. 

Our algorithm for USTCON is now obtained as follows. We pick a set of landmarks L, 
consisting of =5^, and p nodes picked uniformly at random from V, and then follow /31ogn 
Metropolis-Hastings walks from each landmark, updating the disjoint-set data structure. Finally, 
the algorithm decides whether =5^ and are connected based on whether these two landmarks 
have been identified as belonging to the same connected component. 

The algorithm never provides a false-positive answer. The probability of identifying a pair 
of nodes and ^ from the same component H C G as not being connected, can be bounded 
using the following argument adapted from Broder et al. Let H be the connected component of 
G containing node J^. If nn > n^/G, then by Lemma O the set L is a set of good landmarks 
with respect to H with probability at least ^ — (note that adding nodes y and ^ to a. 
good set of landmarks cannot make this set of landmarks a bad one). Conditioned on this, by 
Lemma [6l we obtain a correct answer to USTCON with probability 1 — Thus, the algorithm 
works correctly with probability at least 1 — ^. In the case when < np/6, we consider only 
the walks originating from landmark J^. There are /31ogn such (independent) walks, each of 
length Up > 36n|^. It follows from Lemma 3, putting i = 5^ and j = that in this case, node 
.'^ will be reached with probability at least \ — This completes the proof of correctness. 

Proposition 1. For all p > 1, there is an algorithm solving USTCON using space S = 0{p) 
and time T = 0{n'^p), where Up = max{7^ log n, A}, with probability of one-sided error bounded 
by i. □ 

For the case when p = 0(-^), we have obtained the trade-off T = O(^). We now show how 
to obtain the claimed trade-off in the general case. 
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3.2 Removing the dependence on maximum degree 

We now remove the dependence of length of the used walks on the value of A. We design a 
graph G* = iV* ,E*) by subdividing the nodes of G, so that each node from V turns into a path 
of nodes in G* with maximum degree bounded by -D + 2, where > 1 is an integer parameter, 
whose value is specified later. Formally, graph G* is defined as follows: 

• For each node v & V,V* contains copies of v, labeled {v, 0), (v, 1), . . . , {v, [^^2^^] — 
1)- 

• Nodes {u,i) and {v,j), u ^ v, are connected by an edge in E* if and only if {u,v} G E, 
iD < POR%{u) <{i + 1)D, and jD < PORTu{v) < {j + 1)D. 

• Nodes {u,i) and {u,i + 1), for all < i < |"^^2|M"| _ ^re connected by an edge of E* , 
with special port labels ^prev' and ^next' at its endpoints. 

Let n* and A* be the number of nodes and the maximum degree of G* , respectively. We have 
A* = D + 2, and the following bound on n* holds: 



s-^ deg{v) sr^deg{v) 2m 



n = 

v&v " vev 

Solving USTCON on G between nodes ,y and ^ can be reduced to solving USTCON on 
G* between nodes (^,0) and (^,0), since the transformation of G into G* does not affect 
connectivity. In order to apply the algorithm for USTCON to G* , rather than to G, we introduce 
the following modifications: 

• Landmarks need to be distributed following the uniform distribution on V* . This can be 
achieved by picking p integers uniformly at random from the range then enumer- 
ating all the nodes of V* in order, and associating the landmarks with the corresponding 
nodes from V* . This operation can be performed in 0{n* +plogn*) time, which is always 
0(m). 

• The performed walks need to follow RW{G\), rather than RW{Gi). A simulation of one 
step of the walk RW{Gi) can be performed in 0(1) time. 

• The duration of each of the performed walks is given as n*-^, where: 

n* = max I7— logn*. A* 1 < max 2m /D , 2logn, D + 2\ (1) 

^ [ p } [ P J 

It follows that the time complexity of the entire algorithm is bounded by the 0{m) complexity of 
landmark distribution and the 0{n*^p) complexity of simulating the Metropolis-Hastings walks 
on G* . Substituting the expression from ([1]) for n*, we have: 



T = 0{m + n*/p) = 0{m + — + j^ + D^p 



Now, putting D = \\/m/p\ gives D^p = @{m), and we obtain the required time bound T = 

■ — '22 ' — ■ 2 

0{m + ^ + ^ + = 0(max{^, m}). Since the proposed solution can be implemented with 
a space bound of 5" = 0{p), we have proven the main theorem of the paper. 

Theorem 1. For all S > clogn, where c > is some model- dependent constant, there is an 

' — ' 2 

algorithm solving USTCON using space S and time T = 0(max{^,m}), with probability of 
one-sided error bounded by ^. □ 



9 



4 Remarks 



Tightness of the trade-ofF. For a space bound S > we cannot hope for an algorithm 
with smaher run-time than T = 0{m), achieved in Theorem [TJ In fact, the lower bound of 
T = Q{m) holds for the RAM model under most reasonable representations of G in the memory 
(cf. Proposition [3] in Appendix B for a standard proof). 

For smaller values of S, the optimality of the achieved trade-off S ■ T = 0{n'^) is open. For 
the extremal case of S = O(logn), the results of [B] imply that T = il(n^) for any determin- 
istic algorithm using a jumping automaton (JAG) with at most one movable pebble. There is 
also little hope of improving the time complexity using randomized algorithms similar to the 
Metropolis-Hastings walk, since Nonaka et al. |20j showed that any walk, having a stationary 
distribution which is (almost) uniform on the nodes of the graph, has ^l{n?) cover time for some 
graphs. 

Even more strongly, one can ask whether there exists an algorithm for USTCON which 
runs in 0(1) space and 0{m) time. This appears unlikely in view of the negative result of 
Edmonds [13], who showed that a randomized JAG using 0(1) space and o(logn/loglogn) 
pebbles requires in expectation ?7,^+^(^)/^°§'°s" time to explore certain 3-regular graphs. 

Fine-tuning the Metropolis-Hastings walk. In view of LemmalU the Metropolis-Hastings 
walk visits all the nodes of a graph within O(n^) steps. This is an improvement with respect 
to the bound of 0{nm) on the cover time of an unbiased random walk. Nevertheless, the 
Metropolis-Hastings walk may perform worse than the random walk for specific graph classes. 
A generic example of such a graph, called the glitter star, was defined by \2Q\ as a tree on 
n = 21 + 1 nodes, with one central node of degree I connected to / nodes of degree 2, which are in 
turn connected to / leaves. On the glitter star, the cover time of the random walk is ©(nlogn), 
and the cover time of the Metropolis-Hastings walk is 0(n^). 

Below we propose a walk RW{Gf) with a different potential function which combines some 
of the advantages of the random walk and the Metropolis-Hastings walk. 

Proposition 2. For a graph G, let the node potential function f : V ^ be given as f{u) = 
'^"^^"^ + 1, where d = ^ is the average degree of the graph. Then, for any pair of nodes u,v £ V , 
the walk RW{Gf) achieves a commute time of: 

ComGf{u,v) = 0{mm{GomG{u,v), Comc^ (u, f )}), 

where ComG{u,v) and GomG^{u,v) denote the commute times for the random walk on G and 
the Metropolis-Hastings walk, respectively. A step of the walk RW{Gf) can be simulated using 
0(1) space and time. 

The above Proposition implies that for any graph, the walk RW{Gf) with f{u) = + 1, 

is asymptotically not slower than the unbiased random walk in terms of parameters such as 
maximum hitting time and (arbitrarily weighted) average hitting time. At the same time, 
this walk preserves the upper bound of 0{v?) on the cover time in the graph, making it an 
interesting alternative to the unbiased random walk in practical applications, e.g., for different 
random graph models. 

We remark that there exist different ways of combining the unbiased random walk and 
the Metropolis-Hastings walk. For example, one may consider an automaton which iteratively 
performs a phase of the walk RW{G), followed by a phase of the walk RW{Gi) of the same 
length, doubling the lengths of both walks in each subsequent iteration. Such a walk visits all 
the nodes of the graph in expected time asymptotically equal to the cover time of the faster of 
the two walks. 
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Appendix A: Implementation 

For the sake of completeness, below we provide the pseudocode of the algorithm for USTCON 
announced in Theorem [TJ The implementation is self-contained, except for the following subrou- 
tines. The disjoint-set data structure is implemented by the procedures: SET{x) which adds a 
new set containing only element x to the data structure, FIND{x) which returns (the identifier 
of) the set containing element x, and UNION{Si, S2) which replaces sets Si and 5*2 by set 
Si U 5*2 in the data structure. Each of these operations is performed in amortized 0(1) time. 

The routine TRAV ERSE_EDGEy{port), for a node v & V, returns a pair (u,inport), such 
that u G r(f ) with PORTy{u) = port, and inport = PORTu{v). This routine can be performed 
in 0(1) time in the RAM model, as well as in most J AG-based models. 

We recall the values of the absolute constants: 7 = 60 and (3 = 72. 

1 1 Solution to USTCON using p auxiliary landmarks 
procedure test_connectivity {J/', nodes from V) { 

L^{(^,0),(^,0)}; 

/ / Distribute p landmarks uniformly on V* 

I ^ multi-set of p integers chosen uniformly at random from the range {1, 2, . . . , n*}; 
i ^ 0; 

for V gV do 

forj^O,l,...,r^l-ldo{ 

i ■i^ i + l; 

if ie £ then L ^ LLl{{v,j)}; 

} 

for / € L do SET{1) ^ I; 

II From each landmark, run /31ogn* Metropolis walks RW{Gl) of length n*^ each 
repeat f3\ogn* times { 

for / G L do { 
s ■(^ I; 

repeat [max{7^ log n*, D -|- 2}]^ times { 
s ^ next_state* (s); 
UNION{FIND{s), FIND{1)); 

} 

} 

} 

if FIND{{y,0)) = FIND{{^,0)) then return "connected"; 
return "probably not connected"; 



II Simulate one step of the walk RW{Gl) from state {v,i) £ V* 
function next_state* (v. node, vJ.: integer) { 

V-deg* •^get_degree*(u, i;J); 

port ^ get_random_port*(T;, vJ); 

if port = ^prev' then { 
u v; 

U-i ^ vji — 1; 
} else if port = ^next' then { 
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uJ f J + 1 ; 

} else { // port G [left, right] is an integer corresponding to a port at v in G 
{u,inport) TRAVERSE_EDGE^{port); 

} 

U-deg* get_degree*(it, 

with probability min{ ^^^g* , 1} do return (n, nJ); 
return {v,vJ,)\ 



II Return the degree of {v,i) in G* 
function get_degree* {v: node, i: integer) { 
left i- D; 

right ■<— min{(i + 1) ■ D — 1, deg(f )}; 

deg* ^ right — left + 1; 

if left > then deg* ^ deg* + 1; 

if right < deg(t;) then deg* deg* + 1; 

return deg*; 



1 1 Return a port at node (v, i) in G* chosen uniformly at random 
function get_random_port* {v: node, i: integer) { 
left ^ i - D; 

right ^ min{(i + 1) • — 1, deg{v)}; 

deg* get_degree* {v,i); 

with probability {right — left + 1)1 deg* do 

return integer from range [left, right] chosen uniformly at random; 

neighbors ^ 0; 

if left > then neighbors neighbors U {^prev'}; 

if right < deg{v) then neighbors neighbors U {'next'}; 

return element of neighbors chosen uniformly at random; 
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Appendix B: Auxiliary claims 



Lemma 7. For all i,j G V, EiNj{t) = EjNi{t). 

Proof. Let Xu{t), u G {hj}, denote the random variable equal to 1 if a walk of length r is 
located at u after r steps, and otherwise. Since RW{Gi) is a reversible Markovian process, 
by the properties of the r-th power of the transition matrix of the walk (cf. [1], Chapter 3.1), 
we have: 

7:{i)EiXj{T)=TT{j)EjXi{T). 

Since 7r(i) = 7r(j) = it follows that EiXj^r) = EjXj(r). Taking into account that Nu{t) = 
^*~QXu(r), u G by linearity of expectation we obtain the claim. □ 

Lemma 8. For any node i G V: 

E^Niit) = - (2) 
n 



an. 



d for any arc eij of G corresponding to an edge G E: 



E,iVe.,(t) = -min|-i-^,-i— |. (3) 
' n tdeg(«) deg(j)J 

Proof. Follows directly from the stationary distribution of the Metropolis-Hastings walk on 
nodes and edges. □ 

Proposition 3. Any algorithm for USTCON requires time ^{m). 

Proof. Consider a generic instance of USTCON defined as follows. Take two disjoint copies 
of some 2-edge-connected graph H on n/2 nodes, with one distinguished node x. The two 
copies of H are assigned the subscripts 1 and 2, respectively. Now, as the considered instance 
of USTCON we use, with probability 1/2, the disconnected graph Hi U H2 with 5^ = xi and 
=^ = X2. Otherwise, we pick an edge {n, of H uniformly at random, and use as the instance 
the connected graph i^i U i/2 U {{^25 ^'i}, {^^i, ^^2}} \ {{"Ui, ^^i}, {^*2, "^2}}, likewise with y = xi 
and ^ = X2. Subject to a choice of node identifiers in the representations, the connected and 
disconnected instances differ on precisely 4 memory cells in the adjacency lists of the graph (for 
nodes ui, U2, fi, and ^2), and these cells, taken over the choices of edge {n, form a partition 
of the memory representation of the graph. Consequently, the expected number of memory reads 
for an algorithm deciding connectivity with probability 1/2 + p is lower-bounded hy p-m/A^ and 
is thus i7(?n,), within the range n < m < n^/8 — 0{n). □ 



Appendix B: Proofs of technical lemmas 
Proof of Lemma [2] 

The interested reader may see this proof as an analogue of the discussion for short random walks 
in regular graphs, cf. Aldous and Fill, Chapter 6, Proposition 16. 

Claim (i): Consider a shortest path P in graph G from i to a nearest vertex j £ V \A. Let 
P = {io,ii, . . . ,ia,j), where zq = i, and G ^1, for < Z < a. Let G° be the subgraph of G 
induced by nodes from set A, their neighbors in G, and node j: G° = G[A U N{A) U {i}]. Since 
any random walk in G which starts from i and does not enter y \ ^ is confined to nodes and 
edges of graph G°, we have the following relation between the walks RW{Gi) and RW{G\): 

EiTv\A<^iT^\A = ^^T° <Com°{i,j)=R°{i,j) ^ w{e), (4) 



V 



where the latter equahty follows from the electrical network representation of random walks. The 
resistance R°{i,j) is upper-bounded by the resistance of the series connection going through the 
nodes of path P in G: 

a-l 

= max{deg(zo),deg(zi)}+. . .+max{deg(za-i),deg(ia)}+max{deg(ia),deg(ij)} < 2 ^ deg(i;)+2A. 

1=0 

Since the path Pg = {io,h, ■ ■ ■ 5*a-i) is a shortest path in graph G between nodes iq and ia-i, 
such that Ps QA and T{Ps) C A, it follows that (cf. P): 

a-l 

Y,degiii)<3\A\, 

1=0 

and: 

R°{i,j) <6\A\+2A. (5) 

Since the total weight of edges and self-loops of G incident to a vertex in V is equal to 1, we 
have: 

eeE(G°) ^eA \«er(i,)u{t;} / «er(j)u{j} 

Claim (i) follows from inequalities ([!]), (HI), and ([6]). 

Claim (a): Suppose that s = \/6t > ^, and let: 

^ = {jEF:E,iV,(t)>s}. 

Since the considered walk hits nodes from V a total of (at most) t times, we have |^| < ^ < n, 
and the considerations performed in the proof of Lemma[5][i) can be applied for the above-defined 
set A. 

First, we bound the expected number of returns to node i for a walk starting at i before 
reaching V \A for the first time: 

E,N,{Ty\A) = 1 + (1 - PT,[Ty\A < T,]) . E,N,{Ty\^) =^ E,N,{Ty\A) = ^ 

-rrj[Jy\yl < Ii\ 

Taking into account [1] (Chapter 3, eq. (28) and Corollary 11) and bound ([5]), we have: 
E,N,{Ty\^) = ^ = 7T{i) ■ R{i,j) ■ E He) < vr(0 • i?°(i, j) • E < 

^ eeE{G) e€E(G) 

< -•(6|A| + 2A)n = 6U|+2A<6- + 2A. (7) 
n s 

It follows from Lemma [7] that the definition of set A may be rewritten as: 

A = {j£V: EjN^{t) > s} 

Thus, V\A = {j£V: ¥.jNi{t) < s}, which means that if a walk starting from i reaches V \A, 
it will return to i at most s times in expectation before time t. So, using d?]), we obtain the 
claim: 



EiNi{t) < EiNi{Ty\A) + s <6^ + s + 2A = 2\f%t + 2A < h^ft ^ 2 A. 



□ 
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Proof of Lemma [3] 

Fix an arbitrary arc eij, with {i,j} S E. We will bound the sought probability from the 
inequality: 

IE.iVe,,(t) < Pr.[re,, < t] Ee,^.iVe.,(t) =^ Pr:^[Te,, <t]> ^^^j^^'^l - (8) 

The expected number of traversals of for a walk of even length starting from the stationary 
distribution on V is given by equation ([3]). 

To bound the expectation from the denominator of ([8]), we note that by Lemma EJii), 
EjA'j(t) < 5\/i + 2 A, and that arc Cij is chosen with probability min | deg(i) ' dcg(j) } "during each 
visit to i: 

EiA^e,, (t) < {hVt + 2A) min ^ ^ 



deg(i) deg(i) 

Considering a walk starting from a traversal of arc e^j, we observe that after its traversal of e^j 
the walk must return to node i before traversing Cij again: 



^e- .Ne \t) < 1 + E,-iVe- (i) < l + ^iNe- it) < 1 + (5\/t + 2A) min | — , , I 



< 



(9) 



By combining inequalities ([3|), ([8]), Q, and taking into account that t > A^, we obtain the 
claim: 

t t Vi 

PljTe-. <t\> p > p > 0.1 — . 



□ 



Proof of Lemma 3] 



Pick a node j € V according to the uniform probability distribution tt. We will bound the 
sought probability from the inequality: 

E^Njit) < Fn[T, < t] E,N,{t) =^ Pn[T, < t] > ^j^. (10) 

Taking into account Lemma \7\ and condition ([2]) , and noting that j is chosen according to the 
uniform distribution vr on V, we have: 

E^Njit) = EjN,{t) = E^Ni{t) = -. (11) 

n 

The expectation from the denominator of (jlOp is bounded by Lemma^ii), EjNj[t) < 5\/t + 2A. 
By combining the above relations, and taking into account that t > A^, we obtain: 

Pr,[r,- <t]> > > 0.1^. 

^ n(5^/t + 2A) 7n^/i n 

□ 
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Proof of Lemma [5] 

Fixing a connected component H C G with uh > np/6, we introduce the following notation for 
a set of landmarks L: 

• let Lh = LnV{H), 

• let X{L) denote the event that \Lh\ > \p^} 

• let Fi{L) be the random variable over L describing the maximum, over all non-loops arcs e 
belonging to H, of the probability that a set of p random walks RW{Gi) of length t = rip 
each, with one random walk originating from each landmark from L, does not cover arc e. 

• let F2{L) be the random variable over L describing the maximum, over all nodes u G V{H)^ 
of the probability that a random walk RW{Gi) of length r = ni, originating from u, does 



not hit any landmark of L. 



Suppose that L is a set of p nodes picked according to the uniform distribution vr^ on . To 
prove the claim of the Lemma, we need to show the following bound: 

Prwp[Fi > A F2 > n-i] < ^. (12) 

We observe that each landmark from L belongs to V{H) with probability nujn. Let Lu = 
L n V{H). A w.h.p. lower bound on the size of Ljj follows from the Chernoff bound applied to 
p Bernoulli trials with success probability nn/n: 

ViL^^AX] > 1 - esP^ > 1 - e-48P^ > 1 - e-«'°s" > 1 - ^, (13) 

4n 

where we took into account that Hp > 7^ logn, and that 7 = 60 > 48. In the following, we only 
need to show that, conditioned on the event X{L) holding, L is a good set of landmarks with 
probability 1 — Note that all the landmarks from Lh are distributed uniformly at random 
on V{H), also when conditioned on X{L). 

To bound Fi{L), fix a non-loop arc e of as the arc maximizing the failure probability in 
the definition of Fi{L). By applying Lemma[3]to graph H, the probability that a walk RW{Hi) 
of length r = rip, starting from the uniform distribution on V{H), does not cover arc e, is at 
most 1 — . Thus, considering that: 

1 riH • 3 log n • 3 log n 

\Lh\ > ttP = -^TH ^ FTl ' 

2 n 6^ logn O.lrip 

the probability Fi^(.{L) that no random walk starting from a landmark hits arc e is bounded by: 

(n 1 \ 3 log n 

Likewise, to bound F2{L), fix a node u G maximizing the probability that a walk 

RW{Gi) of length t = rip, originating from u, does not hit any landmark of L. By Lemma U 
the probability that the considered walk of length r does not cover a node chosen according 
to the uniform distribution on V{H), is at most 1 — Thus, taking into account that 

\Fh\ > oT^31ogn, the probability that the walk does not hit any landmark can once again be 
bounded as less than n~^: 

^L^nP [F2 I X] < n~\ 
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It follows that: 

[F1 + F2 I X] < 2n-^ 

and by the Markov bound: 

PrL-.p [Fi + F2 > I X] < ^ < -3-. (14) 
Now, inequalities ()13p and ()14p imply that inequality ()12p holds, which completes the proof. □ 
Proof of Proposition [2] 

We begin by observing that the unbiased random walk on G can be described as a weighted 
Metropolis-Hastings walk RW{Gf^), where, for all u G V, the potential function on nodes is 
given as fc{u) = cdeg(ti), where c > is an arbitrarily chosen constant of proportionality 
iw{e) = c for all edges). Now, looking at the electrical networks analogy, by identifying with 
each other the corresponding nodes of the electrical networks describing the walks RW{Gf^) 
and RW{Gi), and leaving the edges of both these networks in parallel connection, we obtain a 
new network on G with edge weights Wf given by: 

Wf{e) = WfSe) + w{e), 

corresponding to the potential function on nodes: 

f{u) = Uu) + l = cdegiu) + l. 

It follows that the resistance of replacement of the network of RW{Gf) for any two nodes 
u,v £ V can be bounded as: 

RGf{u,v) < Rgj^{u,v) and RGf{u,v) < Rgi{u,v). 

Moreover, the following relations hold between resistances and commute times: 

GomGj^{u,v) = 2cmRGj^{u,v) 

GomG^{u,v) = nRG^{u,v) 
GoniGj {u, v) = (2cm + n)RGj {u, v) 
Fixing c = 2 = ^1 i-6., 2cm = n, we obtain from all of the above relations: 

ComGf{u,v) = 0{inm{GomGf^{u,v),GomGi{u,v)}). (15) 

□ 
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